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' Seven typical f acult^\ooncerns about ;,the 
'appropriateness of using ratings of ins^uqtor and ins'.truction are 
^examined. These are summarized in terms of common observation^ 
frequently expressed by faculty: (1) Students cannot make consistent 
judgments because of their immaturity, IsLck of exp^^rience, and 
capriciousness; and a wid'ely^ held' belief is that only Colleagues with 
excellent publication records and exp^rienbe are qualified to 
evaluate their peer iasii^tion . (2) Most student rating schemes 
are nothing more th.an a popularity contest. ^3) Students are not able 
t-O make accurate judgments until they have .been away from the course 
and possibly from the university for several years. (4) The student 
rating forms are unreliable and invalid. -(5) There are extraneous 
variables or conditions that can affect student ratings, including 
class size,, schedule, term, student sex, major, and level. (6) The^ 
grade a* student receives in the course is highly correlated with his 
rating of tke course and the instructor. (7) A/ qu€lstion frequently 
raised is how student evaluations can be used to improve instruction. 
Eesearch addressing these problems is cited that makes use of the' 
Illinpis Course Evaluation Questionnaire (CEQ) . (LBH) / ^ 
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us DEPARTMENT OF ME ALTH A ^^^"^ '' ' > * " ^ , • • \ 

» EDUCATION * WeCFAHE • \ * , *^ . . ^ 

, "'"ToUIV.Si'""^" . ^ TYPICAL FAGULTY 'concerns ABOUT . \ 

THIS OOCO/VENT HAS BE t N f^LPkO .' o / " :, 

OUfED EXACTLY AS KEtftvtd ^ UQ/V ' « » r ' ^ 

r.;^,r?s°N'?r;':;';;:^^^^^^^^ . studenx^evaluamon of instruction^ . • ' 

STATED DO NOT NEf ESSAK .v wtPPt t ° * « 

EDUCATION POSITION o» POlKV \ ' t -k* a i . ^ ' \' ^ " • 

• \ ' JLawrence M. Aleamoni ^ 

V ' 1^ t'he past fev7 years there have been many proposal's for evaluating 

instruction and a ew of them were a Lso 'concerned with trying to/^elat^'' 

rsr\ evaluation to the improvement of -Instruction. Most proposals suggested 

frH . the use of similar elements in the .evaluation procedure. These includfe 

J (a) judgment by stuSen^, peer, s.^lf, and supervisor (department headj, 

* • . ■/' 

and (b) judgments, of ^course' material, coGrse content, coutse "objectives, 

^ quality of student learning: If, however,' one looks for actual 

^^^ ^ ^ * 'o ^ 

working models of instructional evaluation,! it Us itrtmediately apparent 

that schemes involving systeiriatic ratings by peer, supervisor, or self, 

oj: of material, tontent, etc, are rarely actualized. More often than 

not, the student ratings of instructor and instruction appear as .the 

f |k ^ only el^ents in any of the '*worlCing models" and .there are many reasons 

/ ■ • ■ 

one couid'cite for this. This paper, however', will focus specifically 

^ on seven typical faculty concerns about th6 approp/riateness of using 

-atings of instructar^and instruction, at/ all.' These are summarized ^ 

^^low in terms of common observations fi/equently expressed by faculty, 

(a) Students cannot make consistent judgments concerning 

' the instructor And^inst^uGtion because of their imraatur- 

; , ity, lack oi^ experience, and capricioursness. Conversely, 

^ ___ ; ' • A ' • 

W An invited address l^^repared for presentation in the Symposium oi;i 

Methods of Improvi-ng ^University Teaching at the Technion Israel 
Institute of Technology^ Haitaj Israel on March 2A, 1974, i 

^ ' '2 " ^ J 

\i 'The author is indebXed, to Robert H. Davis and Joseph S. Marcus 

\. * for their constructive suggestions, . i 

» ■ 
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(b) A x^iUely held belief , is that; only colleagues* with exQell- 
ent publication records and' experience are qualified to. ' 
evaluate their peer instruction. # ^ 

Most student rating scliemes are notl^i^g more than a popularity 
cornest, vith *the warm, friendly, humoVoua, easy grading 
instrucJUJr emerging as the^inner^ ' ' 



Students are itot able t,o make ^gcijrate judgments until they 
have b^en away from the course and possibly away from' thfi uni- 
versity for several yfears. 

The student ra'ting forms are both uhreliable and invalid. 
There, are e3<;trarieous ^vafiablQS or conditions that can Effect 
Student ratings. Some of the more common bHoCs are: 

(a) the .3iy,e of the class . 

(b) the^sex of the student * •» '* 

(c) the time of. day the course was offered - V k * 

(d) Whether the student was taking the course ds a reJuirement 
, or on an elective basis ^^"^ — - 

(c) whether ^|J|e student was a major or .a nbn-majaj: 

(f) the term (or*^ semester) the course, was offered 

(g^ the level of the course (freshmen, sophomore, junior, 

senior, graduate) 
(h) ^the I'ank of the instructor (instructor:, assistant 

• 'professor, associate pro'feasor, full professor) 
The grade or mark a student receives in the course is highly 
correlated with his rating of\the course and the instructor; 
Finally, a question ^hat is frequently raised is "How can 
student ^evaluations possibly be used to improve instruction?" 

V 



Surprising as it may be, answers to 'these problems and questions 
can be fou^id in a pzethoija of researcl/ that' spans at least 50 years. 
Itost of this research hae oeen conducted . u&ing student evaluation ^ x ' 
(rating) questionnaires similaV to tjie one presently Used at: the Uni- 
versity of Illinois at tJrfcana-Champai^nXtilUC)'- and entitled -the 
Illinois Course Evaluation Questionnaire (CEQ). A copy of the CEQ 



is presented in Appendix A. 



Be^f^re beginning' tp cite and summarize^ the res^ajpch addressing 
each of the ptobleiDB an<J questions abovej a brief description of the 
CEQ will be presented in order- tp provide a Aeaningful frame, of refer- 



ence f on the various stiidies. " 

The CEQ is an ^instxjument used to collect studenjt attitudes and 
opinions toward a course (Aleamoni, 1972a;'Aleamoni and Spencer, 1973).* 
Its purpcipe is to enable faculty rpembers to collect evaluative irxfor- 
mation about their teachlna* The data is collected and processed by 
course section but may' a. .so be processed by course, d6partment| college^ 
etc. . Extensive norma tiv(5 data hab been gathered on the CEQ over the 
past 10' years and thi^g provides the instructor witJ) valuable comparisons 

on theN instructional dimensions of (a) General Course Attitude, (b) Course 

1 ^ ■ , 

Content, (c) Method of liistrtiction, (d) Interest and Attention of the 



students,* and (e) the Ins 
sent the subscales of the 
are ua6d'to help provide 
through appropriate norm 
results are compared with 



true tor. . These l^nstructiortal dimensions repre- 

( . ■ ■ - 

CEQ. Th^ 23 items tha\.make up the subscales 
some diagnostic feedback to the .instructor 
comparisons. For example, each instructor's 
those of pther ihstructora of hfs own academic 



J < 




, rank I teaching at Xh^ -same cour'S« level and in his ewn department, - ^ 

■ ; \ ' - ' . ' ; r ■ ' ' ' 

^xollege ot university, as'well as ' with, coui\^s th^^t have used the CEQ . 

• / , ' ' ■ * ■' 

throughout the United Stafes. / . ' - , ' » 

r' i ' 

The student -responses to the CEQ ^re anonyufous, and tyo copies 

of the queefrionaaira ^:^esults {sojo. Appendix B) along with interpretative 

infbrmation are returned only tb the instructor, 'The instructor m&y 

/ , " .. ^ 

declde^to submit sne copy to his dep^irtment chairman for rank, pay, andt, 

tenure' consideration, but' the CEQ ia primarily used to prpvide feedba^ 

to instructcyrs as to wh6re potential problems may exist in the classroola. 

♦there is ample space on the CEQ form for instructors to utilize more 

specifJLcally diagnostsic items in Identified j^rpblem areas. Coiyferences 

relatitre to" the interpretation anc^ utilii:'ation of results may be 



arranged at the instructor's 'convenience with consultants from the . ^ 
Measurement "and Research Division of the Office of Instructional Resource's 
at, UIUC. ^ ■■ • ' ■ 

' \ I ■■ * ' 

i With that brijf description of the CEQ aa background^ responses to 

* ■ • . • ■ 

the eleven concern^ are how presented in the order of their presentation 
abovei' * • * 

^ (a) Students cannot ofensistently j udge instructor and ^instruc- 

tion. There is ample- evidences on thist?poinfc dating *back^o 192A, 

/ ' * 

according /to Gutrhrie (195A) , in which reliabilities of student rat inga 

, • " , ■ ~ . . ■■ ^ ...... , ' . - ■ 

rema^in irt the .80 to .90 range. More recent 'literature on- the subject 
by Costin, Greenough add Menges (1971) and Aleamonk (1972b> has shoWh v 
that well developed j^nstruments and administration procedures can con- . 
silently yield 'high reliabilities (i.e'.', reliabilities in the .gO's), 
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'OnlyN^olXoaRues with excellent . publlcaclon records arid eaj^erl- 

- encea are qualified to evaluate their peer's Ins eruption' . Wherever a 

tlls^usalon about or a proposal for student ratings eme'rjj^s, this state- 

- cah usually be heard. RecenUy, a we].l known statlsticfan preleated . 

just such an agrument In The American Statistician (Demlng, 1972). 

Fortunately ^or unfortunately for those who believe such a -contention) ^" 

about the time. that Professor Demlng 's article appeared a study had been' 

•cjsmpleted addressing that very, topic. Aleamonl and Ylmer (1973) found 

t-hat colleague and atudent ratings were not significantly related to the 

'^instructor !s research productivity (the correlations were .07 and' -.OA. 

respectively). In addition, there was ample evidence previously (Guthrie, 

1954; ^Stallirigs and Spencer, ^967; Swanson and' Sisson, 1971) to show that 
< / 

eague and student rajtrings were very highly correlated (from .63 to 
»70). The- response- to Professor Deming's arttple can be found in a 
\ater issue' of The American Statistician (Aleamonl, 1972]^. 

2. Mist student rating schera^ are nothing more than a popularity 
contest. Answers to this problem are presented from published and uh- 
published studies, on the CEQ and 'rhe Advisor (a stud«nt-8iionsored fotm) - 
(Feldman, 1970) at UTUC. The studies conducted in developing and uti- 
lizlng the CEQ subscal^s^, (Aleamonl- and Spencer, 1973) indicated that no . 
single subscale (t.e., Method of Instruction)' completely overlappe^d the 
other subscales. Basically^ this means that an instructor yho received 
a high decile rating on the Instructor subscale (made 'irp ot itenxs like 
"The ina^rubt^secmed to be inter^ted'in students as persons/*) wobld 
not be guaranteed high decile ratlngai on the other four subscales* 
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(General^ Course Attitucje, Method of Instruction, Course Content, and ^ 
Interest and Attention). * In order to more fully explo^re this p-rotrltiiii, 
the written comments mapfe by students jjn both .-the CEQ and* The Advisor 
were revl^^wed and compared to their objective responses. The results ' 
indicate'ci that students would frankly praise an instructor 'for his 
watm, friendly, humorous, etc., manner in the classroom, but if his 
course was not well organized or his method of stimulating students 
to; learn was poor, the students would equally frankly criticize him 
in those areas. When these comments were compared to the objective 
measures in the same lir-eas, a high degree of relationship was observed. 
This'evi'dence, in addition to .that presented b^Costin, et al.,' (1^71), 
indicates that students are discriminating judges and not easily fooled 
*by the go\5d ^^showman" who is lacking in the other instructional quail- 
ties. . ' ^ 

3. ' Students cannot? make accurate judgments until they are out of 



the course ancj away from the university for several years . This' point 
is repeatedly raised by faculty and was rcpently presented Jjy McKeachie 
(1969). This problem is a very difficult one with which to deal because 
longitudinal ;follow-up ^tudies need a great deal of attention to the 
question of whether samples are comparative and representative. The 
sampling problem Is further compounded by the fact that almost all stu- 
dent attitudinal data relating to a course or instructor is'gathered 
anonymously. Most studies in this area, therefore, have relied on sur- 
veys of alumni and/or gr^uating seniors. > 

Oixe of the earliest studies by Drucker and Remmers (1950, 1951) 
showed that alumni who were out of school five tq ten years rated the 



instructors much the same as students currently enrolled. More recent 

evidence by Aleamoni and Yimer (1974) , further substantiates the eatlier 

findings. This evidence seems to indicate^ contrary to popular belief 

N^d speculation, that students are ver^ perceptive in^their judgments 

and^are in' substantial agreement with pejers who have been out of the 

course and away from the university for several ye^rs, Avvery care- 

fully aontrollcd follow-up studyi however, needs |:o be conducted in 

order to folly answer this problem. * ' ^ 

' . 1.- . ' 

IK 

A . The s tudent rat in p; forms are ^oth unreliable and Invalid . In 
order to answer this problem it puat be dividdhd into two portions, one 
concerning the reliability of student rating forma ahd the other,* the 
validity of student rating forms. 

The research J:iterature id replete vxlth studies that answer the 
question of, the i^ellabiUey of s^^pnt rating forms. Almost all of the 
Instruments which h/ivo been carefully constructed and* tested^by pro- 
fessionals yield reliabilities at . the level of .SO-and .90 on the 
subacales as well as the total Instrument (Costin, et al., 1971). 
* Reliabilities comput'ed on the Items and subscales maklrvg up the CEQ 
(Aloamonl, 1972b), for example, have yielded Item reliabilities rang- 
ing from .73 to .94 and 'subscale reliabilities ranging from .80 to 
.98. It should be noted, hovever, that wherever student rating forma 
are not carefully constructed with the aid of professionals, as in the 
case of mosf^student generated forma (Everly and Aleamoni, 1972), the 
reliabilities may be so low as to-completely negate the evaluation 
effect and its results. 
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Trying Co mswer ttfe problem of ^th^/validity of student rat'ing 
forms is muc;h more difficult than ad^essing- the reliability problem. 
In ordej: to yalidatV something one must have a criterion measure for 
comjjarison. One of the criterion measures that can be- used to vali- 
date student rating fatTns is to determine how well the items and 
subscales measure i-zhat Is intended (called contervt validity). «^ This 
is usually accomplished by carefully constructing the instrument sa 
that it contains items and subscales that will yield measures in the 
areas that are considered necessa-ry by ^ individual or group of 
experts in the £leld under consideration. Most of the student rating 
forms generated' were validated by using Just this sort of approach 
(C>3^|tin, ct al., 1971). The use o£ statistical Cools like Factor 

' " / • 

Analysis have ai^o been used to verify sub^ctiVely determined dim- 
ensions of the insccuctional setting and pVocess. The CEQ used both 
Statistical (Factor Analysis) and subjective expert judgments in 
^ generf-tfin^ the items and a0bscal6e that majce^up the form (Alearaoni' 
ucxd Spencer, i973)si. 

s 

Many other criterion raeasures have been suggested by which to 
va-iidace student ratings. Some of fhose are peer (or colleague rat- 
;iag8), oxpiSiTt Jud/^.s' ratings, 8»:udent learning, etc. You wiil 
notice that many of the problems and questions that faculty pose, 
such as the seven stated above^ can also be Interpreted as validity 
concerns. In order to avoid an^ redundancy of answers to the faculty 
concerns, let me simply indicate that studies in which student rat- 
ings were ccipaied to (a) calleague rating (Guthrie, ^95^\ Swanson 
and.Sisaon, i9";l; Aicamoni and Yimer, 1973), (b) experf'judges* 
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ratings (Stal-lings and Sp^ncer» 1967), and.(c) student learning measures 

. • / . . • - 

/[Cohen and/Berger, 1970) all indicated the existence of high positive ^ 

correlations which can be considered as providing additional validity 
evidence. ^ , 

^ • extraneous variables or conditions affect student ra&inRfi^ ? 

Studies conductexl on the (a) size of the class v^tGuthrie, 1954; Costin, 
et al., 1971; Aleamoni and Graham, 197^), (b)' sex of the student (Costtn, / 
et al., 1971; Aleamorii, 1972b), (c) time of day the course was offered 
(Aleamoni, 1972b), and (d) term (^s^n^ester) the coarse was offered 
(Cos tin, et al., 1971; Aleamoni, 1972b), indicate that these vi^triable^ 

had little or no relationship to the student ratings, Xhfe ^jrankj of the 

. ' ^ ' ^ I ' ' 

instructor (Guthrie, 1954; Costin, et al . , 1971; Aleamoni and Graham. 

1974) seems to have s5me effect but it is\ua\ially not quite s tatis t^ically 
significant." ' 

On the other rtand, ^a) .whether the student wjas taking'the coujse ad 
a requirement or orf an elective basis (Costin, etlal., 1971; Gillmore 
and Brandenburg, 1974), and (b) thie level of the cjourse (Costin, 1971; 
Aleamoni and Graham, 1974) yielded significant effects on student ratings. 
Such effects^' however, can be controlled through the use of appropriate^ 
normative data, which is an;important feature of "the results reported for 
the CEQ. ^ 

The one study cited by Costin, et ai., "(1971) indicated that whether . 
the student was a major or a non-major did not affect his -faculty rating. 
This concern is presently l^eirxg-lnvestigated using CEQ data. 

6. The yrade or mark a student receives .in the course is highly 
correl&ted to his rating of the ^giourse and the instructor . There is ample 

. . , ■ • to ■ 
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evidence in the research literature to provide a definite answer to, 
this concern. In almost all of the' studies cited in Costin. At kl./ 
(1971) ^nd by investigators such as Guthrie (1954), Renuners (i^^) 
and WqAver (1960) little or no relationship has been 'lEoimck between 
a student's grade jirtd' faculty rating. In' fac/, the p'^aitive corre- 
lations seldom exceed .30. The evlde^d. the^refore, indicate^ that 
students 80 not necessarily rate an instr^6tor or course based upon 
tl>e grade they have or are about to j?6cetve. { 

^ ' student evalOations j^sibly be used, to improve 

> instruction? This cpuld well be the most important quiistion to be 
asked concerning student ovaluat/on of instruction. Th^re has been 
a great deal <5f discuaelon in the research liter/it'ure about how, when, 

and where such evaluations should be used, but no clear-cut evidence 

^ 1 

l^B been offered to show that it does have an effect on instruction. 
The^ studies by Miller (1971), Braunetein, Kle>n^and>aQhla (1973), '/ 
and Centra Cly973) were inconclusive* wich/eapec^ to the ef fect of 
feedback at micjLterm to instructors wli^e instrt/c^ion was again eval- 
uated at the end of the term. Hpw^r. such elkdence ifl found in a 
recently completed ^tudy by Ale^oni (1974), where student ratings 
gathered near the end of ^tho;/erm, on th'^ CEQ, were presented to Uni- 
versity instructors alopi^'Htrb the olpportunit^ of discussing their 
results wioh a mpasurement and evaluation expert. The CEQ ratings * 
were again gathered at the end of the same cour-ses (one semester to 
a year later) taught by the same instructors. The results revealed 
that there was a significant increase. in the student' ratings of 
these faculty on the two lowest, rated CEQ subscales that were discussed 

in the meetings'^ with the measurement and evaluation expert. Op the* 

-1. 
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other hand, the group of facrul\:y who was. not able to a^rali thema'^^visa ' 
6/ expert; consuLtati^n but diH receive the" CEQ results, remained un- :. 
changed in their subscale ratings." Even though this study needs to ' 
^ be replicated, it represents the first tangible evidence that aWdent 
• ratings can be used to improve instructidU. • " 

It should be obvious , by now that the problems and questions that 
faculty typically raise about the appropriateness" of using stodent 
ratiogs of ine-tructor and inslruptioh have* very definite answers which, 
call be interpreted as lioing highly supportive for using such ratingd. 
Interastingly enough, yfaany faculty will atill disregard the evidence 
•. and will mai-ntain clfat there s^lll is not" enough evidence or that, there 
are, still too Inany unairswercd' questions, and problems to take student 
ratings seriously. However, "these same faculty would stout ly-d^l^d ' 
^heir own metho.ds of eyaLuating students even though they might not be 
able t^ prlisent any evidence to substantiate their claims. 

In conclusion, therefore, it might be- useful to reverse the situa- 
tion and ask faculty members to consider the seven concerns posed- above 
from the point of view of faculty evaluating student a .' How' much evl- ' 
dWe woul(} or could be provided to convince, the students that: 

(a) Faculty can consistently juclge student learning?, and 
,(b)' the performance of atudjsnts w^h excellent ability is not usdd 
to set the standard for the rest of the students In the course? 

2r Most faculty grading schemes are not affected by the' attentive, 
polite, conforming, and non-creative student? 

3, Whdt was taught in the coru^se is useful in other cours.es or 
outside that university? * ^ • 
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. '4.. \Ihe courpe examinatl^s are reliable and valid? ' 

5. An -Instructor's marfcaA or grades are hot affected, by : 

(a) the size of the c\ass? * ' 

(b) > I the sex'of the student? 

(c) ^ the* time of day the course was offered? 

(d) i(?hether the student was taking the course .as a required 
-or an elective? 

. ' - * (e) whether the student was a^^majox^or a non-major?' ' ♦ 
. (f) the term (or sem^st«^) .the^\course was offered? 
(g) the level of the course? \ / 
(hi) his professional rank?\ v- 

6. Intstryctprs Whp had a particularly rough tiiae when they were, 
in college do; not tend to be just as rough\ on their students? 

7.. Th'e coursaupxarainations are useful, in improving their learning? 
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PLEA^.r ('"^V Tm.'- '•• r/r ThT TiRM tor YOmp-? FTR^ONAL COMMr.NTS ON TEACHER t rrrCT ' VFNE "^5 AND GFfir^AL C0UR*3C VALU5-'- 

THEN Tvi^^4 T Y^\ri' A'.'' A.V«lR tMifCTiVF .juC'>TiOM': C'N ThC rfHCR '-IC^F, i n.G .PENC t L >O^U r , YOUH .iNSTt^UCTOR 

WILL NOT .FE ^(-jl COM^l.TTrt' FVAl'JATlOr- JNt^feL ATTFR r i u ALgJ? AOE ART rOH VCniK COURSE. . ^ 



ipURSE CONTENT . * * ^ * 

PLFAIE G'Vr y-' I'-f CiMMFNT', n^J ThE COuWT C'-NTFNT, il'HjFCT MAT'I'E R^ ANC^ any PAfJT'CULAH KEUFVANCC THi:- COUR'-.E haC 
HAD TO YOUH AREA OF STUDY, 



mSTRUCTORS 



Wrjte.the name of your Principal instructor * T.A. 

What are yS'jr genfral comments about thf i nstruc TOR(^:i ) in this couBse? 



INST RUCT'ONAL^JECT I VE" 

ERE THE I NGTR'jCT ) ONAL OH J E C T t V E . ^ LE A R LY STATED FOR THIS COUR-SE? Y E '3 



rjo . 



PAPERS AND HOMEWORK < ' ' 

Comment on the value of noofl||^/ homework /ano papers ( if atjy ) in this C'Ourse< 



C ommf 



■ ' ■ ' ■ - V 

EXAMS ' ' 

CoVif^NT on the exams (qimz/cs, prAcjicals} as (to t)t rr I ct;LTY, FA-'RMrss, etc, 




GENERAL 

1. What i mj^roveme nt s in this course wouLt* you suggest': 



PLEA'tE'GIVE YOiJR THOUGHTFUL EVACUATiON OF THIS ^COURSE WITH COMMENTS. ARF YOU SATISFIED WITH WHAT YOU 
GOT OUT. OF THIS COURSE? O'OiYOU CONSIDER it A VALUAULC EDUCATIONAL EXPERIENC^? '^jI^IPLY /^MFANS or PASSING 
A*REOU 1 RFMCNT? . J)R A D I S A P P a ' N TMC N T ? . PLCASe: COMMENT. 
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f^ORM 73 IJLI.IT^OIS COURSE EVALUATION QUESTIONNAIRE . CEQ 

MARK; ' I - 



CA IF YOU STRdNGLV A&Rf? 

WITH THE item" 



WITH THE ITEM 

Q IF VOU DISAGREE MDDEPATtLt 

* i^H The iTE m' 

CQ If YOU &TRO><GL,V 0'SA6RE«.w 

W I Tk THf ! ^E.M "* . 
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'l. MARK ONLY Ofel^/ 

RESPONSE PER ITEM ■ 
USING PENCIL 0^I1Y I 

2. ERASE CHANGED 

ANSWERS CLEAl^LY ■ 
AND COMPLETELY. b) | 
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1 .voiild Mke^jnothei (.om se ,th.Jl vv.is l.iui^hl this .*.jy 

I /iCKjIfl hJ>*ynief erred another ^'pthO(j of te.JC^i^^kj irs IMis cours«^. 
It .v.is e.JSy to re'Mjin jtlendve. " < . 

The instriJt^toTcTici NOT synthesize, "t/tcii'jtf or *>i.:M*'Kjrize effectively .^ 
NOT 'Hue h VMS gjined by t.ikmg thrs coiirse. 

The mstrucitaf eficour.'^^d the development o1 'le/v vte/^[30wits .ind (ipprecidttons. 

. , ■ , . r > 

I le.if,n ;nore ^/hen other leoLhing rtietfiods dre-d^bd. 



,1 :4 



^> The c^)urse ^r.nterral seemed worth// hile 
*The inAtri,Jctor //as excellent. 
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The insiructof d^'ionslr.ited .i thorouj^h knowledge of the subject matters 

\ ^ ' ' : , ^ 

a » ■ ■ • . 

k^ould fcWher NOT t.iKX» another course from this instructor. 

I' • ^- 

It w<is a v<^iy ^vorth//hHe course. 

^ i 

Soi'ie things ^vero J^OT explained very .veil. ^ 
The course ^>cUefi.il a."js loo difficult. 
This //cts one of "ly poorest coursed. 

The instructor se^^'f^ed to consider ffte-ichinK- , is .1 choro ot routine .ictivity. 
Jl W.1S quittjll^lerestrng. 
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I think thJl the course- was taught cftJtle well. 

Tftn course conterrt was exceiler^l. 

Some days I //as N^ very mtpfested in this course. 

It was fjuite baling. , . . ' 

» ■ • 

Overall the coursp was good. 
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7^ A a C t> C 7.) A R C 0 t B ( 0 ^ ' >j 1 ^ 

CjC fO »5/ir>D Omc A L ICANN IN a Con roil ATJON^ 



A r 'i A D C D r /f^A 6 C O /e, A B f. D f 7 ; A 0 G D E 



p i A n c b 6 H3 A i) c. t) E g/j A B c p I A u b 6 eI'i 
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MEKMAC ^- TEST (A.MA-LYSIS A.^D gUfc Sf I ^iNM A I f<E fihC^l * « 



RESULTS FOR. THE OBJECTIVE ITEMS UN \hE CEQ FCRM 73 QUESTIONNAIRE-^ 
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f-Kt*>H ST^PH JK —yn — bkAU UIHbS — OTTTr 
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